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DETAILED ACTION 
Response to Arguments 

The Examiner acknowledges the Applicants' amendments to claims 1, 12, 16, 22, 24, 26, 
41, 47, 49, 51, 66, 72, 74, 76, 77, and 78, as well as the addition of new claims 98-103. 
Regarding independent claims 1, 22, 24, 26, 47, 49, 51, 72, 74, 76, 77, and 78, the Applicants 
argue that one of ordinary skill in the art would not have been motivated to modify Loveman 
(U.S. Patent No. 6,21 1,869 to Loveman et al.) in view of Clarin (U.S. Patent No. 6,414,725 to 
Clarin et al.), as submitted in previous Office Actions. The Examiner respectfully disagrees, 
specifically for the reasons described in the previous Office Action, mailed 1 1/3/2004. 

Further regarding the independent claims, the Applicants argue that this combination of 
Loveman and Clarin fails to teach providing content in a third format, lower than lower 
resolution content used in editing, as has been added to each of these claims. The Examiner 
respectfully disagrees. As described more fully below, Loveman teaches presenting to the user 
thumbnails of low resolution content (for example, such thumbnails are designated by reference 
number 532 in figure 1 1, and described in column 17, line 43 - column 18, line 60 of Loveman). 
These thumbnails are considered a third format of the content, having a lower resolution than 
that of the lower resolution content. 

Specifically regarding claims 16, 41, and 66, the Applicants argue that the described 
combination Loveman and Clarin fails to teach superimposing timecodes on individual frames of 
lower resolution content, as has been added to each of these claims. The Examiner respectfully 
disagrees. As illustrated by reference numbers 516 and 510 in figure 1 1 of Loveman, and 
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described in column 18, lines 1 1-25 of Loveman, timecodes are clearly depicted as being 
superimposed over individual frames of lower resolution content. 

The Applicants' arguments filed 3/3/2005 have thus been fully considered, but are not 
persuasive. 



Claim Objections 

Claim 22 is objected to because of the following informalities: the phrase, "is accessible 
more quickly that the high capacity storage," is considered grammatically improper. Appropriate 
correction is required. 

Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

Claims 1-4, 6-29, 3 1-54, and 56-103 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over U.S. Patent No. 6,21 1,869, which is attributed to Loveman et al. (and hereafter 
referred to as "Loveman"), and also over U.S. Patent No. 6,414,725, which is attributed to Clarin 
et al. (and hereafter referred to as "Clarin"). In general, Loveman describes a "digital 
multimedia system," which is used by journalists and editors to create news stories that are 
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comprised of video, text, and graphics (for example, see column 4, lines 28-39). Such a digital 
multimedia system is considered a "content production system" like that of the claimed 
invention. 

Specifically regarding claims 1 and 76, Loveman discloses that the above-described 
digital multimedia system comprises a "multimedia capture and encoding system" which 
receives content in an initial format and reformats the received content into a first version having 
a first format and a second version having a second format, wherein the second version has a 
higher resolution than the first version (see column 4, lines 28-46; column 13, lines 14-20; and 
column 14, lines 13-22). This multimedia capture and encoding system is consequently 
considered an "ingest system" like that described in the claimed invention. Furthermore, 
Loveman discloses that the two versions of the multimedia content are stored in a "multimedia 
storage system" (see column 4, lines 47-55). The lower resolution content may particularly be 
stored in a "multimedia archive system" (see column 17, lines 14-22; and column 15, lines 30- 
59), and the higher resolution content may be stored in a "media server" (see column 20, lines 
19-39; and column 12, line 49 - column 13, line 14). Loveman discloses that the media server is 
a high-capacity server, comprising the ability to maintain the higher resolution content in near- 
line and off-line storage, such as on tape or optical disks (see column 12, line 49 - column 13, 
line 14). Additionally, Loveman discloses that the multimedia archive system, which is part of a 
"core newsroom system," may be accessed through a faster network than the media server, 
which is part of a "video production system" (for example, see column 12, lines 18-34). Because 
of these different network speeds, because tape storage requires a relatively large access time, 
and because the higher resolution content requires more bandwidth than the lower resolution 
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content (for example, see column 7, lines 53-54), it is understood that the content stored on the 
multimedia archive is accessed more quickly than the content stored on the media server. 
Loveman thus discloses storage for storing the lower resolution content in a fast access storage, 
specifically a multimedia archive, and storage for storing the higher resolution content in a high 
capacity storage, specifically a media server, whereby the fast access storage is accessible more 
quickly than the high capacity storage. Additionally, Loveman discloses that the digital 
multimedia system also comprises a "video editing and playback system," which is used to 
generate a composition using a selected portion of the content having a low resolution, and 
retrieve and play back the composition using the corresponding portion of the content having a 
higher resolution (see column 4, line 56 - column 5, line 4; and column 17, lines 43-54). Such a 
video editing and playback system is consequently understood to comprise an "edit station" and 
a "retrieval apparatus," like those recited in the claimed invention, wherein the edit station is 
used for selecting a portion of content from the lower resolution version, and the retrieval 
apparatus is used for receiving from the edit station a description of this selected portion and 
retrieving the portion of the higher resolution content corresponding to this selected portion. 
Moreover, it is understood that this edit station comprises a graphical user interface with a 
storyboard window, displaying a plurality of clips representing portions of the low resolution 
content (see column 17, line 55 - column 18, line 25). These clips, each depicted as a small 
rectangular object showing a frame of the corresponding low resolution content, may be selected 
in order to play its corresponding low resolution content (see column 18, lines 1 1-25; column 18, 
lines 47-55; and figure 1 1). Since these clips each show a small sample of the initial content, 
they are considered a format of the initial content, and since they are depicted within a smaller 
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area than the low resolution content and only comprise a single frame, they are understood to be 
of a lower resolution than the low resolution content. Accordingly, it is understood that the 
above-described ingest system of Loveman additionally reformats the initial content into content 
having a third format with a lowest resolution, whereby this third format of the content is stored 
with the lower resolution content in fast access storage, so that it may be retrieved and displayed 
and used to access the lower resolution content at the edit station. Loveman discloses that this 
edit station is connected to a multimedia storage system via a network, by which it accesses the 
multimedia storage system to "browse" and select a portion of the lower resolution content (for 
example, see column 5, lines 5-62; column 7, lines 1-37; and column 17, lines 43-64). Loveman, 
however, does not explicitly disclose that the edit station comprises a browser to selection 
portions of the lower resolution content, as is expressed in claims 1 and 76. 

Like Loveman, Clarin describes a system for receiving content in an initial format, and 
for reformatting the content into content having a first format and content having a second 
format, wherein the second format has a higher resolution than the first format (see column 2, 
line 60 - column 4, line 24). Clarin additionally describes an edit station for selecting and 
specifying a portion of the low resolution content, which like that of Loveman, is stored remotely 
over a network (see column 4, lines 40-64). Specifically regarding the claimed invention, Clarin 
teaches that such an edit station may implement a browser to select a portion of the low- 
resolution content (see column 4, lines 25-39). 

Therefore, it would have been obvious to one of ordinary skill in the art, having the 
teachings of Loveman and Clarin before him at the time the invention was made, to modify the 
edit station taught by Loveman, such that is includes the browser of Clarin for searching and 
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selecting portions of lower resolution content. It would have been advantageous to one of 
ordinary skill to utilize this combination, because such browsers are inexpensive, readily 
available, and provide a familiar graphical user interface, as is taught by Clarin (see column 4, 
lines 25-39). 

Concerning claims 26, 51, 77, and 78, the above-described digital multimedia system of 
Loveman and Clarin is understood to necessitate software and teach a method for: receiving 
content in an initial format and reformatting the received content into content having a first 
format with a lower resolution, content having a second format with a higher resolution, and 
content having a third format with a lowest resolution; storing the lower resolution content and 
the lowest resolution content in a fast access storage and the higher resolution content in a high 
capacity storage, wherein the fast access storage is accessible more quickly than the high 
capacity storage; selecting a portion of content from the lower resolution content using a 
browser; and, receiving a description of the selected portion and retrieving a portion of content 
from the higher resolution content corresponding to the selected portion. Such a method is 
considered a method like that of claims 26 and 77, which is for producing content, and such 
software is considered a program product, like that recited in claims 51 and 78. 

Regarding claims 2-3, 27-28, and 52-53, Loveman discloses that the above-described first 
version of the reformatted multimedia content is a low resolution version, and that the above- 
described second version of the reformatted multimedia content is a high resolution version (for 
example, see column 4, lines 28-39). Moreover, Loveman discloses that each version comprises 
digitized video content (see column 14, lines 13-22; and column 13, lines 14-37). It is therefore 
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understood that the first version comprises low-resolution digitized video content, and that the 
second version comprises high resolution digitized video content. 

As per claims 4, 29, and 54, Loveman discloses that the above-described first version of 
the reformatted multimedia content may be an MPEG-1 encoded stream (see column 5, line 63 - 
column 6, line 19). Thus the first version is considered to comprise "MPEG1," as is expressed in 
each of claims 4, 29, and 54. 

With respect to claims 6-7, 31-32, and 56-57, Loveman discloses that the above- 
described multimedia capture and encoding system is connected to a network, which is used for 
transmitting data (see column 5, lines 19-34; column 14, lines 13-22; and column 13, lines 14- 
20). This multimedia capture and encoding system, which is considered an ingest system as 
described above, is therefore understood to be "web-based" like recited in claims 6, 31, and 56. 
Moreover, Loveman discloses that the above-described video editing and playback system is 
connected to a network, which is used for sending and receiving data (see column 5, lines 19-34; 
column 5, lines 50-62; and column 16, line 64 - column 17, line 1 1). Therefore, this video 
editing and playback system, which is understood to comprise an edit station as is described 
above, is considered "web-based" as recited in claim 7. Since the ingest system and edit station 
are both web based, the method taught by Loveman and Clarin, which comprises these systems, 
is also considered web based as recited in claims 32 and 57. 

In reference to claims 8-9, 33-34, and 58-59, Loveman discloses that the above-described 
first version of the multimedia content, which is of lower resolution than the second version, is 
stored in fast access storage during editing. Specifically, the version is stored in disk storage (for 
example, see column 8, lines 18-40). 



Application/Control Number: 09/829,584 Page 9 

Art Unit: 2173 

In regard to claims 10, 35, and 60, Loveman discloses that the above-described second 
version of the multimedia content, which is of higher resolution than the first version, may be 
stored on tape storage (for example, see column 12, lines 49-60). 

Referring to claims 1 1, 36, and 61, the multimedia capture and encoding system disclosed 
by Loveman receives content in an initial format and reformats the received content into a first 
version having a first format and a second version having a second format, wherein the second 
version has a higher resolution than the first version, as is described above. Loveman 
particularly discloses that this multimedia capture and encoding system comprises a "media 
recorder" (see column 14, lines 13-22), which receives the multimedia content in its initial 
format, and digitizes and compresses the content into the first and second versions (see column 
13, lines 14-37). Since the initial format is digitized, or in other words, converted from an analog 
to a digital format, it is understood that the initial format prior to this digitization is analog. 

Concerning claims 12-13, 37-38, and 62-63, Loveman discloses that metadata may be 
added to the stored multimedia content (see column 19, lines 21-63). It is therefore understood 
that the digital multimedia system of Loveman comprises an apparatus for adding metadata to 
the stored content. Specifically regarding claims 13 and 38, Loveman discloses that such 
metadata may comprise "user defined elements," or in other words, user input (see column 19, 
lines 48-56). 

In regard to claims 14-16, 39-41, and 64-66, Loveman discloses that timecodes 
identifying corresponding portions of the above-described first and second versions are stored 
with the first and second versions, respectively (see column 20, lines 19-39). The timecodes 
associated with the selected portion of the first version, i.e. lower resolution version, are used to . 
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retrieve the corresponding portion of the second version, i.e. higher resolution version (see 
column 20, lines 19-39). Moreover, Loveman presents a graphical user interface used to create 
compositions of the multimedia data, wherein the timecodes associated with the first version are 
superimposed on images of the first version (see column 18, lines 1 1-25; and reference number 
5 16 in figure 1 1). Accordingly, it is understood that there necessarily exists some mechanism 
which superimposes the timecodes over the individual frames of the lower resolution content. 
Such a mechanism is considered part of the ingest system of claim 1, which formats initial 
content into the lower resolution content. 

In reference to claims 17-21, 42-46, and 67-71, the video editing and playback system of 
Loveman and Clarin is understood to comprise an edit station, which is used to select a portion 
of content from the low resolution version of the multimedia content, as is described above. 
Loveman particularly discloses that such an edit station comprises software for searching the 
lower resolution content based on user specified criteria (see column 17, lines 44-64). Moreover, 
Loveman discloses that the edit station provides an interface for viewing the lower resolution 
content and selecting portions therefrom (see column 18, lines 47-55). Also provided by the user 
interface of the edit station is a "storyboard window," which allows users to create a sequence of 
selected video clips in order to produce a news story (see column 18, lines 47-55). As this 
storyboard window allows clips to be laid out in sequence, according to the user's desire, it is 
interpreted that the sequence can be modified until the user is satisfied with the sequence. Thus 
the edit station of Loveman is understood to further comprise software for creating a list of 
selected portions of the lower resolution content, whereby this list may be modified. Lastly, 
Loveman discloses that this list may be provided to the above-described retrieval apparatus, i.e. 
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"video editor," which retrieves and displays clips of higher resolution content corresponding to 
the list (see column 18, line 56 - column 19, line 20). Thus the description sent to the retrieval 
apparatus comprises this list. 

With respect to claims 98-103, Loveman describes a journalist workstation, part of the 
above-described "video editing and playback system," which is used to generate a composition 
using a selected portion of the content having a low resolution, and retrieve and play back the 
composition using the corresponding portion of the content having a higher resolution (see 
column 4, line 56 - column 5, line 4; and column 17, lines 43-54). This journalist workstation 
comprises a graphical user interface with a storyboard window, which as described above, 
displays a plurality of . clips representing portions of the low resolution content (see column 17, 
line 55 - column 18, line 25). As further described above, these clips are considered a third 
version of the initial content, and are considered to exist in a third format, having a lowest 
resolution. These clips are each depicted as a small rectangular object, considered a thumbnail, 
which shows a frame of the corresponding low resolution content, and which may be selected in 
order to play the corresponding low resolution content (see column 18, lines 1 1-25; column 18, 
lines 47-55; and figure 1 1). Accordingly, this third format is understood to comprise thumbnail 
representations of the low resolution content, which like recited in claims 98-100, is used as 
metadata describing the low resolution content. Loveman discloses that these thumbnails may be 
arranged in a sequence, whereby the low resolution content corresponding to the thumbnails may 
be displayed to the user according to the sequence (for example, see column 18, lines 46-55). 
Such a sequence is considered a "storyboard" like described in claims 101-103. Consequently, 
the above-described combination of Loveman and Clarin is considered to teach that selecting a 
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portion of content from the lower resolution content comprises searching the lower resolution 
content, reviewing the content having the third format, i.e. thumbnails, as metadata of the content 
having the lower resolution format, and preparing a storyboard using the content having the third 
format. 

In regard to claims 22, 47, 49, 72, and 74, Loveman and Clarin present a content editing 
system, method, and program product wherein multimedia content is reformatted into a plurality 
of versions having different resolutions, wherein lower and lowest resolution versions are stored 
in a fast access storage, and a higher resolution version is stored in a high capacity storage, and 
wherein the fast access storage is accessible more quickly than the high capacity storage, as is 
described above. In particular, the low-resolution version and the lowest resolution version may 
be stored in a first server, namely a "multimedia archive," as is described above. The low 
resolution content may be accessed, viewed, and selected on an edit station using a browser, as 
further described above. Specifically, the multimedia archive server provides the low resolution 
content to a content editing application implemented on a journalist workstation, whereby 
selected portions of the content may be viewed and edited (see column 16, line 64 - column 17, 
line 11; and column 17, line 44 - column 18, line 60 of Loveman). Thus the server of the 
multimedia archive is considered to host a content-editing application enabling access, viewing, 
and selection of portions of the low-resolution content. Moreover, Loveman discloses that a 
plurality of such journalist workstations may be in communication with the multimedia archive 
server (see column 14, lines 35-45), each workstation implementing the content-editing 
application to search, view, and select portions of the low resolution content and from the 
selected portions, create an edit list for use in retrieving corresponding portions of the high 
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resolution content (see column 16, line 64 - column 17, line 11; and column 17, line 44 - 
column 19, line 20). Clarin complements the teachings of Loveman, and particularly teaches 
that such a journalist workstation may implement a browser to select portions of the low 
resolution content, as is described above. Thus the content editing system of Loveman and 
Clarin comprises a plurality of clients in communication with the server, each client enabled to 
run the content-editing application to search, view, and select portions of the low resolution 
content using a browser, and from the selected portions, create an edit list for use in retrieving 
corresponding portions of the high resolution content. 

As per claim 24, the multimedia archive server of Loveman and Clarin, which is 
described in the previous paragraph, is understood to necessitate software for enabling access, 
viewing* and selection of portions of the low resolution content and lowest resolution content 
from a file stored in a fast access storage accessible to the server. Moreover, each of the 
journalist workstations, which are described in the previous paragraph, are understood to 
necessitate client software for searching, viewing, and selecting portions of the low resolution 
content using a browser, and from the selected portions, creating an edit list, i.e. story board for 
use in retrieving corresponding high resolution content in a high capacity storage accessible to 
the server, wherein the fast access storage is accessible more quickly than the high capacity 
storage. This server software and client software is considered to constitute a "content editing 
software application," like that of claim 24. 

With respect to claims 23, 25, 48, 50, 73, and 75, Loveman discloses that the above- 
described edit list is sharable with other journalist workstations, i.e. clients, through the 
multimedia archive server (see column 18, lines 47-60). 
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With respect to claims 79-81, Loveman describes a verification process to determine the 
correspondence between the above-described first version of the multimedia content, and the 
above-described second version of the multimedia content (for example, see column 6, lines 31- 
67). This verification is particularly done by a "capture manager," which is part of the above- 
described ingest system of Loveman (see column 5, lines 35-43, and column 6, lines 31-67). 
Consequently, it is understood that the above-described system of Loveman and Clarin, which 
comprises such a capture manager, performs the verification process described in each of claims 
79-81. 

Concerning claims 82-84, Clarin teaches that for an encoded multimedia data stream to 
be displayed to the user, the encoded data must be converted into an audio and video format (see 
column 4, lines 24-39). Consequently, it is understood that the playback system, i.e. retrieval 
apparatus described by Loveman, which is used for retrieving and displaying a portion of 
encoded, high-resolution multimedia content for final editing (for example, see column 4, line 56 
- column 5, line 4; and column 7, lines 1-23), inherently converts the encoded content into a 
third format, specifically an audio and video format, such that the multimedia content can be 
viewed for final editing. 

Regarding claim 85, both Loveman and Clarin disclose that a server hosting a content- 
editing application also enables access and viewing of the low-resolution content (for example, 
see column 8, line 18 - column9, line 8; and column 17, lines 43-64 of Loveman; and column 4, 
lines 25-39 of Clarin). Additionally, both Loveman and Clarin disclose that each of a plurality of 
clients is enabled to run the content-editing application to search and view the low-resolution 
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content (for example, see column 7, lines 38-52 of Loveman; and column 4, lines 10-39 of 
Clarin). 

With respect to claims 86-97, Loveman discloses that the multimedia archive, which as 
described above is considered a fast access storage, comprises a "library server" used to catalog 
and retrieve low resolution content (see column 15, lines 30-59). Additionally, Loveman 
discloses that the low resolution content may be transmitted from the server via a stream, that it 
may be displayed at the user's computer as it is delivered (for example, see column 9, lines 9- 
35). Clarin similarly teaches streaming low resolution content from a server (see column 4, lines 
24-39). Consequently, the above-described multimedia archive of Loveman and Clarin is 
considered digital library with media streaming capability. 

Claims 5, 30, and 55 are rejected under 35 U.S.C. 103(a) as being unpatentable over the 
combination of Loveman and Clarin, which is described above, and also over the 
"VideoUniversity.com" website (which is hereafter referred to as "VideoUniversity"). As shown 
above, Loveman and Clarin present a system and method like that recited in claims 1, 26, and 51. 
Loveman particularly describes a multimedia capture and encoding system, i.e. ingest system, 
which receives content in an initial format and reformats the received content into a first version 
having a first format and a second version having a second format, wherein the second version 
has a higher resolution than the first version (see column 4, lines 28-46; column 13, lines 14-20; 
and column 14, lines 13-22). As shown above, Loveman teaches that the format of this first 
version may comprise MPEG1. Moreover, Loveman discloses that the format of this second 
version may comprise MJPEG, such that it is of television broadcast quality (see column 6, lines 
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3-19). Loveman therefore does not explicitly disclose that the format of the second version 
comprises MPEG2, as is recited in each of claims 5, 30, and 55. Similarly, Clarin fails to teach 
that the format of the second version comprises MPEG2. 

Like Loveman and Clarin, VideoUniversity discusses video editing, and more 
specifically, presents several video-editing systems (for example, see page 1). Regarding the 
claimed invention, VideoUniversity discloses that "while MJPEG is excellent for delivering 
fantastic video quality out to tape, it is a poor choice for multimedia" (see page 3). As described 
above, the content production system taught by Loveman is used to capture and edit multimedia 
content. Moreover, VideoUniversity describes MPEG2 based video compression and compares 
it with MJPEG, stating that "... the quality of [these] MPEG2 based cards is outstanding. 
MPEG2 is a much more efficient compression than MJPEG, so you can maintain video quality at 
V2 the data rate! !" (see the bottom of page 3). 

Therefore, it would have been obvious to one of ordinary skill in the art, having the 
teachings of Loveman, Clarin, and VideoUniversity before him at the time the invention was 
made, to modify the multimedia capture and encoding system of Loveman and Clarin such that 
instead of reformatting the initial content into an MJPEG format, it reformats the content into an 
MPEG2 format, as is taught by VideoUniversity. It would have been advantageous to one of 
ordinary skill to utilize such a combination because MPEG2 provides similar quality to that of 
MJPEG at a lower data rate, as is taught by VideoUniversity. 
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Conclusion 

The prior art made of record on form PTO-892 and not relied upon is considered 
pertinent to applicant's disclosure. The applicant is required under 37 C.F.R. §1.11 1(C) to 
consider these references fully when responding to this action. The U.S. Patent of Snook cited 
therein teaches converting video content into thumbnails, which like described in new claims 98- 
103, may be used as metadata describing the content, and may be used to generate a storyboard. 

Applicant's amendment necessitated any new grounds of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Blaine Basom whose telephone number is (571) 272-4044. The 
examiner can normally be reached on Monday through Friday, from 8:30 am to 5:30 pm. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Cabeca can be reached on (571) 272-4048. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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